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controller coupled to the system memory controller and a 
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MEMORY SYSTEM INCLUDING A MEMORY 

MODULE HAVING A MEMORY MODULE 
CONTROLLER INTERFACING BETWEEN A 
SYSTEM MEMORY CONTROLLER AND 
MEMORY DEVICES OF THE MEMORY 
MODULE 

RELATED APPLICATIONS 

This application is related to and claims the benefit of the 
filing dates of the following United States Provisional patent 
applications: (1) Provisional Application No. 60/067,824, 
entitled DISTRIBUTED CONTROL MEMORY BUS 
ARCHITECTURE, filed on Dec. 5, 1997; and (2) Provisional 
Application No. 60/067,588, entitled DISTRIBUTED CON- 
TROL MEMORY BUS ARCHITECTURE, filed on Dec. 5, 
1 997 . These applications are assigned to the same assignee as 
the present application. 

This application is also related to U.S. patent application 
Ser. No. 09/023,234, entitled MEMORY MODULE 
INCLUDING A MEMORY MODULE CONTROLLER 
filed on Feb. 13, 1998, and U.S. patent application Ser. No. 
09/023,172, entitled MEMORY MODULE CONTROLLER 
filed on Feb. 13, 1998, each of which is assigned to the 
assignee of the present application. 

FIELD OF THE INVENTION 

The present invention pertains to the field of memory sys- 
tems. More particularly, the present invention relates to a 
memory system that includes a memory controller on a 
memory module. 

BACKGROUND 

Memory modules such as single in-line memory modules 
(SIMMs) and dual in-line memory modules (DIMMs) are 
typically used to store data, instructions, and other informa- 
tion in computers or other digital systems. FIG. 1 shows a 
typical memory system in which processor 102 communi- 
cates with dynamic random access memory (DRAM) devices 
110-117 on memory modules 106 and 108, respectively, via 
memory controller 104. Memory controller 104 communi- 
cates appropriate memory instructions (e.g., write, read, 
refresh, etc.) to memory module 106 via address and com- 
mand bus 118, and to memory module 108 via address and 
command bus 120. Data is transferred from memory control- 
ler 104 to both modules via bus 122. 

There are at least two disadvantages associated with the 
conventional memory system of FIG. 1: (1) buses 118, 120, 
and 122 are multi-drop buses that have high capacitive loads 
which require large drivers in memory controller 104 and in 
DRAMs 1 10-1 17 (to drive bus 122); and (2) there tends to be 
large mismatches in loading between the address and com- 
mand buses and data bus 122, These disadvantages combine 
to reduce the maximum operating frequency, increase power 
consumption, and decrease performance of the system. Addi- 
tionally, memory controller 104 may include a high number 
of pins (e.g., approximately 190 pins for a 4 DIMM SDRAM 
system) to support access to memory modules 106 and 108. 
The bus width of data bus 122 is often 64 or 72 bits wide to 
support larger bandwidths, for example, of up to 100 mega 
transmissions per second (MT/s). 

FIG. 2 shows another typical memory system that uses 
technology from Rambus, Inc. of Mountain View, Calif. In 
this system, processor 202 communicates with Rambus 
dynamic random access memory (RDRAM™) devices 
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210-217 on memory modules 206 and 208 (also called Ram- 
bus in-line memory modules or RJMM™ modules), respec- 
tively, via memory controller 204. Memory controller 204 
communicates appropriate memory instructions (e.g., write, 

5 read, refresh, etc.) and data in a time-multiplexed fashion to 
memory modules 206 and 208 via memory specific bus 226. 
Each of the RDRAM™ devices 210-217 include interface 
logic 218-225, respectively, that enables the RDRAM™ 
devices to interface to memory specific bus 226. Memory 

10 specific bus 226 may operate at a high frequency (e.g., 250 to 
400 MHz), have a small bus width (e.g., 1 6 or 1 8 signal lines), 
have symmetric loading for address, command, and data 
information, and have a bandwidth of up to 800 MT/s. mother 
embodiments, the address and control information may be 

15 separated (demultiplexed) from the data bus in this environ- 
ment. 

The system of FIG. 2 has a number of disadvantages. Each 
RDRAM™ device includes a significant amount of logic in 
the interface logic which makes implementation of the 

20 RDRAM™ devices more difficult and more expensive than 
other DRAM devices, and which causes the RDRAM™ 
devices to draw more power and dissipate more heat than if 
the logic was not present. This may lead to thermal and 
reliability problems. Additionally, each RDRAM™ typically 

25 includes a delay locked loop (DLL) circuit coupled to a plu- 
rality of clock signals on bus 226. The DLL circuits are 
typically always functioning and drawing significant 
amounts of power which contributes to thermal and reliability 
issues. Additionally, memory controller 204 must include 

30 relatively large drivers to drive bus 226. 

In each of the memory systems described in FIGS. 1 and 2, 
the memory controller must be designed to provide the appro- 
priate memory transactions to the memory devices in a pre- 
determined format and at predetermined times. The memory 

35 devices and memory controller must then be designed to work 
together. It would be advantageous to decouple the design of 
the memory devices and the memory controller such that 
independent advances may be made in each technology. It 
would also be desirable to decouple the operation of the 

40 memory devices from the memory controller to decrease 
power drawn by each memory device and by the entire 
memory system. 

Other features and advantages of the present invention will 
be apparent from the accompanying drawings and from the 

45 detailed description that follows. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The features and advantages of the present invention are 
50 illustrated by way of example and not limitation in the figures 
of the accompanying drawings in which like references indi- 
cate similar elements and in which: 

FIG. 1 is a block diagram of one embodiment of a conven- 
tional memory system; 
55 FIG. 2 is a block diagram of another embodiment of a 
conventional memory system; 

FIG. 3 is a block diagram of one embodiment of a memory 
system according to the present invention; 
60 FIG. 4 is a block diagram of another embodiment of a 
memory system according to the present invention; 

FIG. 5 is a block diagram of one embodiment of a dynamic 
random access memory (DRAM) module including a DRAM 
memory module controller; 
65 FIG. 6 is a block diagram of one embodiment of a static 
random access memory (SRAM) module including an 
SRAM memory module controller; 
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FIG. 7 is a block diagram of one embodiment of nonvola- 
tile memory module including a nonvolatile memory module 
controller; 

FIG. 8 is a block diagram of one embodiment of the 
memory module controller of FIG. 3 coupled to a time mul- 
tiplexed system memory bus; 

FIG. 9 is a flow chart of one embodiment of the process 
implemented by the memory module controller of FIG. 8; 

FIG. 10 is a block diagram of one embodiment of the 
memory module controller of FIG. 3 coupled to a demulti- 
plexed system memory bus; 

FIG. 11 is a flow chart of one embodiment of the process 
implemented by the memory module controller of FIG. 10; 

FIG. 12 is a block diagram of one embodiment of a 
memory module including a memory module controller inter- 
facing SDRAM devices with a system memory bus using a 
Direct Rambus™ protocol; 

FIG. 13 is a flow chart of one embodiment of a read trans- 
action implemented by the memory module controller of FIG. 
12; 

FIG. 14 is an exemplary timing diagram of the read trans- 
action implemented by the memory module controller of FIG. 
12; 

FIG. 15 is a flow chart of one embodiment of a write 
transaction implemented by the memory module controller of 
FIG. 12; 

FIG. 16 is an exemplary timing diagram of the write trans- 
action implemented by the memory module controller ofHG. 
12; 

FIG. 17 is an exemplary timing diagram of a read transac- 
tion implemented by the memory module controller of FIG. 
12 using a modified protocol; and 

FIG. 18 is an exemplary timing diagram of a write trans- 
action implemented by the memory module controller of FIG. 
12 using a modified protocol. 

SUMMARY OF THE INVENTION 

One embodiment of the present invention includes a sys- 
tem that has a system memory controller and a memory 
module. The memory module includes a memory module 
controller coupled to the system memory controller and a 
plurality of memory devices coupled to the memory module 
controller. 

Other objects, features, and advantages of the present 
invention will be apparent from the accompanying drawings 
and from the detailed description that follows. 

DETAILED DESCRIPTION 

A memory system including distributed control of memory 
devices on memory modules is described. The present inven- 
tion includes a memory module controller device on each 
memory module in the system. The memory module control- 
ler communicates with the system memory controller over a 
system memory bus and with the individual memory dievices 
at the module level. The system memory bus may be a low pin 
count, high frequency, multiplexed or demultiplexed bus. The 
memory module controller may communicate with the indi- 
vidual memory devices over wider, lower frequency, demul- 
tiplexed signals lines. As the system memory controller com- 
municates directly with only the memory module controllers, 
the loading on the system memory bus may be reduced and 
the size of the bus drivers in the system memory controller 
may also be reduced. 

The memory module controller on each memory module is 
the interface between the system memory controller and the 
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individual memory devices on the modules. This architecture 
decouples the individual memory devices from the system 
memory bus and the system memory controller. This may 
allow for the independent development of the memory device 

5 technology. For example, the memory devices may be devel- 
oped to be faster, wider, to operate at different operating 
supply voltages, or to operate with reduced voltage swings 
than if the memory devices where directly communicating 
with the system memory controller. 

10 The memory module may have its own memory address 
lines, control lines, and data lines between the memory mod- 
ule controller and the individual memory devices. The signal 
lines for these point-to-point or bus connections may be sig- 
nificantly shorter than the system interconnection buses used 

1 5 in conventional memory systems. This may allow for reduced 
loading, better control of capacitance on the address and data 
lines, and may increase the maximum operating frequency of 
the module while reducing power drawn by the system. Addi- 
tionally, power may be further reduced by omitting DLLs 

20 from the individual memory devices. ADLL may be included 
within the memory module controller if required for interfac- 
ing with the system memory bus. 

FIG. 3 is a block diagram of one embodiment of the present 
invention. System 300 includes processor 302, system 

25 memory controller 304, and memory modules 306 and 308. 
Processor 302 communicates with system memory controller 
304. Processor 302 may be any control logic or microproces- 
sor that communicates write, read, and other memory trans- 
actions to system memory controller 304. System memory 

30 controller 304 communicates the memory transactions to 
memory module controllers 310 and 316 of memory modules 
306 and 308, respectively, via system memory bus 323. Sys- 
tem memory controller 304 may be part of a chip set for a 
personal computer, for example, or it may be other indepen- 

35 dent logic. 

Memory modules 306 and 308 may be SIMMs, DIMMs, 
RMM™ modules, or any other type of memory modules. 
Each memory module includes a memory module controller 
and one or more memory devices. For example, memory 

40 module 306 includes memory module controller 310 and 
memory devices 312-315, and memory module 308 includes 
memory module controller 316 and memory devices 
317-320. The memory module controllers may be separate 
integrated circuits from the memory devices. While system 

45 300 is illustrated as including two. memory modules, any 
number of memory modules may be used. The memory 
devices may be placed on one side of the module, on both 
sides of the module, and/or they may be stacked on top of each 
other. The module may also be a multi-chip module. For one 

50 embodiment, a memory module may have an approximate 
height 350 of from 1 to 2 inches, and an approximate length 
352 of from 4 to 6 inches. 

Memory modules 310 and 316 communicate memory 
transactions with system memory controller 304 via system 

55 memory bus 323. System memory bus 323 may be a low pin 
count (e.g., approximately 16 to 35 address, data and control 
signal lines) bus operating at a high frequency. For one 
embodiment, system memory bus 323 may operate at a fre- 
quency of approximately 200 to 500 MHz. Other frequencies 

60 may be used. System memory bus 323 includes a command/ 
address bus 324 and a data bus 328. Command/address bus 
324 may time-multiplex commands and address information 
on one or more of the signal lines. The command and address 
bus 324 may also be split into separate command and address 

65 buses as in SDRAMs. System memory bus 323 may option- 
ally include clock bus 322 that may carry one or more clock 
signals on the same or separate signal lines, and handshaking 
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bus 326 that may cany a handshaking signal between system 
memory controller 304 and memory module controllers 310 
and 316. The handshaking signal may be generated by system 
memory controller 304, for example, at the start of a memory 
request packet or when it is transmitting valid data on data bus 5 
328. The handshaking signal may be generated by memory 
module controllers 310 and 316 when they are providing 
valid data requested by system memory controller 304 to data 
bus 328. 

For one embodiment, system memory bus 323 may be 10 
compatible with the Direct Rambus™ bus architecture that 
includes 16 or 18 data bits on bus 328, one or more clock 
signals on bus 322, and command and address information on 
bus 324. The clock signals for this embodiment may run at 
rates of approximately 400 MHz enabling a data transmission 1 5 
rate of up to 800 MT/s. For this embodiment, system memory 
controller 304 may be any controller that may be able to 
implement the Direct Rambus™ protocol for memory trans- 
actions on system memory bus 323. Additionally, system 
memory bus 323 may use Rambus Signaling Levels (RSL) for 20 
the signals transferred on the bus. For alternative embodi- 
ments, any other type of appropriate signaling levels may be 
used including TIL, CMOS, GTL, SSTL, CTT or other sig- 
naling levels. 

For another embodiment, system bus 323 may be one gen- 25 
eral purpose bus that carries time-multiplexed address, data, 
and control information. For example, system bus 323 may be 
compatible with Concurrent and Base Rambus™ architec- 
tures. For these embodiments, system memory controller 304 
may be any controller that may be able to implement these 30 
protocols for memory transactions on system memory bus 
323. 

System memory bus 323 may be placed on a printed circuit 
board (PCB) that includes system memory controller 304 and 
interconnection slots for modules 306 and 308 as shown in 35 
FIG. 3. Alternatively, system memory bus 323 may be routed 
through separate channels of memory modules 306 and 308 
such as channels 402, 404, 406, and 408 as shown in FIG. 4. 

Memory module controllers 310 and 316 operate as 
bridges between system memory bus 323, that operates in one 40 
protocol or format, and local or memory module buses (e.g., 
lines 330, 332, and 334-337) that operate in a second differ- 
ent protocol or format. Each memory module includes control 
logic necessary to interpret the memory transaction on system . 
memory bus 323 and translate that transaction into the appro- 45 
priate control, address, and data signals for its memory 
devices on the memory module. Similarly, the memory mod- 
ules interpret the memory transactions on the local or 
memory module bus into the format required to transmit the 
transaction to the system memory controller 304 via system 50 
memory bus 323. 

Memory module controllers 310 and 316 may also include 
circuitry necessary to perform refresh operations of dynamic 
memory devices, prefetch operations, error correction func- 
tions that may use, for example, ECC bits, current calibration 55 
if system memory bus 323 is a current bus, serial presence 
detect circuitry, a DLL circuit, power management circuitry 
that may shut off the clock signals or clock enable signals for 
the memory devices or provide other power down circuits, 
program and erasing voltages for nonvolatile memory cir- 60 
cuits, and/or levelizing circuitry to generate signals on system 
memory bus 323 in the appropriate clock domains (if there is 
more than one clock domain on system memory bus 323). 

Each memory device on the memory modules communi- 
cates memory transactions with its memory module control- 65 
ler via address, data, and control signals. Memory transac- 
tions are those transactions that are appropriate for each type 
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of memory device used. For example, the memory transac- 
tions may include write, read, refresh, prefetch, power down, 
reset, erase, and the like. Memory module 306, for example, 
may communicate memory addresses to memory devices 
312-315 via signal lines 330, control information (e.g., chip 
enable signals, write enable signals, RAS, CAS, output 
enable signals, etc.) via signal lines 332, and data via point- 
to-point connections 334-337. Each of the signal lines 330, 
332, and 334-337 may be one or more signal lines. Signal 
lines 330 and 332 may be buses that connect to all four 
memory devices 312-315, to groups of memory devices (e.g., 
two at a time), or they may be point-to-point connections to 
memory module controller 310. Similarly, memory module 
308 may communicate memory addresses to memory devices 
317-320 via signal lines 338, control information via signal 
lines 340, and data via point-to-point connections 341-344. 
Each of the signal lines 338, 340, and 341-344 may be one or 
more signal lines. 

For one embodiment, the number of signal lines 334-337 
may be the same as the number of signal line carrying data for 
system memory bus 323. For another embodiment, the num- 
ber of signal lines 334-337 may be collectively greater than 
the number of signal lines carrying data from system memory 
controller 304 to memory module controller 310 on system 
memory bus 323. This may increase the bandwidth of the data 
transfer on the memory module. For example, system 
memory bus 323 may carry 16 data signals in parallel on bus 
328 and memory module controller 310 may simultaneously 
provide 16 data signals to each of memory devices 312-315. 
Because the data bus width may be wider (e.g., 64 or 72 bits 
wide) than that of system memory bus 323 (e.g., 16 bits wide), 
memory module controller 310 may supply a clock signal on 
bus 330 to memory devices 312-315 that is a lower frequency 
than that running on system memory bus 323. For one 
embodiment, the clock frequency on bus 330 may be approxi- 
mately 50 to 200 MHz, for example, when the frequency of 
the clock signal on clock bus 322 is approximately 1 00 to 400 
MHz. The frequency of the clock signal on clock bus 322 may 
also be double- pumped, that is, perform an action (e.g., load 
data) on each clock edge. 

By having local address, control, and data lines on the 
memory modules which are decoupled from system bus 323, 
the length of these signals may be reduced over those on the 
system memory bus, the loading of these lines may be 
reduced over that of the system memory, and the loading may 
be more accurately controlled between the different lines so 
as to more closely achieve symmetric loading between the 
signals lines. For example, the loading on the data lines and 
the address and control lines may have approximately the 
same loading (e.g., approximately 10 to 40 pF) plus or minus 
approximately 1 0 percent. This may advantageously decrease 
the amount of power drawn by the module and increase the 
maximum operating frequency of the module for a given 
memory transaction. 

Additionally, by decoupling the memory devices from sys- 
tem memory bus 323 and system memory controller 304, 
memory device 312-315 and 317-320 may operate from 
reduced or different power supply voltages than those pro- 
vided to the balance of system 300. For example, memory 
devices 312-315 and 317-320 (and/or memory module con- 
trollers 310 and 316) may operate from power supplies of 
approximately 1.8 volts to 2.5 volts while the balance of the 
components in system 300 may operate at 3.3 volts or 5.0 
volts. This may also operate to decrease the amount of power 
drawn by the module and thus by system 300. Additionally, 
the voltage swing of the signals on lines 330, 332, and 
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334-337 may be advantageously chosen to be small (e.g., 
approximately 1 .0 to 2.0 volts) to further reduce power drawn 
by memory devices 312-315. 

Power may be further reduced for each memory device and 
for the system as a whole when a DLL is required to interface 
with system memory bus 323. The DLL may be included 
within memory module controller 310 rather than each of 
memory devices 312-315 as my have been required in con- 
ventional systems. 

For another embodiment, address lines 330, control lines 
332, and/or data lines 334-337 may be combined into a 
time-multiplexed bus coupled between memory devices 
312-215 and memory module controller 310. 

The memory devices 312-315 and 317-320 may be any 
type of volatile or nonvolatile memory devices such as 
DRAMs, synchronous DRAMs (SDRAMs), Fast Page Mode 
DRAMs (FPM DRAMs), extended data out DRAMs (EDO 
DRAMs), Rambus DRAMs (RDRAM™ devices), synchro- 
nous or asynchronous static random access memory (SRAM) 
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tile memory module controller 710 that provides an interface 
between nonvolatile devices 712-715 and system memory 
bus 323. Nonvolatile memory module controller 710 trans- 
lates memory transactions received from system memory bus 
323 and generates nonvolatile memory operations (e.g., write 
or program, read, reset, power down, erase, etc.) including 
addresses on address bus 716, data signals on data lines 
723-726, and control signals such as chip select or chip 
enable CE on line 718, write enable WE on line 720, output 
enable on line 722, and a programming voltage on line 728. 
Nonvolatile memory module controller 710 may also provide 
additional control signals to nonvolatile memory devices 
712-715 including clock signals for synchronous operation, 
burst control signals, reset signals, power management sig- 
nals, or other signals or commands. 

With reference again to FIG. 3, system memory controller 
304 and memory module controllers 310 and 316 may com- 
municate using any number of protocols as previously men- 
tioned. In general, these protocols may be multiplexed such 
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ROM (PROM) devices, erasable PROMs (EPROMs), electri- 
cally erasable PROMs (EEPROMs), flash memory devices, 
and the like. Each memory module may include different 
types of memory devices. For example, memory module 306 
may include SDRAMs and memory module 308 may include 
EDO DRAMs, or memory module 306 may include nonvola- 
tile memory devices and memory module 308 may include 
volatile memory devices. 

FIG. 5 is a block diagram of memory module 500 that is 
one embodiment of memory module 306 configured as a 
DRAM memory module. Module 500 includes DRAM 
memory module controller 510 that provides an interface 
between DRAM devices 512-515 and system memory bus 
323. DRAM memory module controller 510 translates 
memory transactions received from system memory bus 323 
and generates DRAM memory operations (e.g. write, read, 
prefetch, refresh) including addresses on address bus 516, 
data signals on data lines 523-526, and control signals such as 
write enable WE on line 518, RAS on line 520, and CAS on 
line 522. DRAM memory module controller 510 may also 
provide additional control signals to DRAMs 512-515 
including clock signals for synchronous operation (i.e., for 
SDRAMs), memory bank select signals, and/or chip select or 
chip enable signals. DRAM memory module controller may 
also generate refresh commands, prefetch commands, and/or 45 
power management commands to DRAMs 512-515. 

FIG. 6 is a block diagram of memory module 600 that is 
one embodiment of memory module 306 configured as an 
SRAM memory module. Module 600 includes SRAM 
memory module controller 610 that provides an interface 
between SRAM devices 612-615 and system memory bus 
323. SRAM memory module controller 610 translates 
memory transactions received from system memory bus 323 
and generates SRAM memory, operations (e.g., write, read, 
reset, power down) including addresses on address bus 616, 
data signals on data lines 623-626, and control signals such as 
chip select or chip enable CE on line 618, write enable WE on 
line 620, and output enable on line 622. SRAM memory 
module controller 610 may also provide additional control 
signals to SRAMs 612-615 including clock signals for syn- 
chronous operation, burst control signals, interrupt signals, 
reset signals, write and read signals (e.g., for a first-in-first- 
out FIFO device), power management signals, byte enable 
signals, and/or expansion signals. 

FIG. 7 is a block diagram of memory module 700 that is 
one embodiment of memory module 307 configured as a 
nonvolatile memory module. Module 700 includes nonvola- 
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is sent over the same bus lines of system memory bus 323. 
Alternatively, the protocols may be demultiplexed as shown 
in FIG. 3 with the data transmitted over a separate data bus 
from address and control information. Whether the protocol 
is multiplexed or demultiplexed, the protocol may also be 
coupled or decoupled. That is, the protocol may be coupled if 
the system memory controller sends its memory transactions 
to system memory bus 323 at a first point in time and expects 
the requested data (in the case of a read transaction) or an 
acknowledgment signal at a second point in time (i.e., a timed 
response). The protocol may be decoupled by using a hand- 
shaking or valid signal to indicate the start of a memory 
transaction or to indicate when valid data is transmitted to 
system memory bus 323 by system memory controller 304 of 
memory module controllers 310 or 316. 

FIG. 8 is a block diagram of memory module controller 
800 that is one embodiment of memory module controller 
310 using a time multiplexed protocol. One embodiment of a 
time multiplexed protocol may be the Base and Concurrent 
Rambus™ protocols. Other protocols may be also be used. It 
will also be appreciated that memory module controller 800 is 
only one embodiment of a memory module controller. Other 
embodiments may also be used without departing from the 
spirit and scope of the present invention. 

Memory module controller 800 interfaces between system 
memory bus 823 that includes one or more clock signal lines 
824, a transaction bus 826, and may optionally include a valid 
signal 828. The transaction bus 826 is a general purpose bus 
that may carry address, data, and control information for a 
memory transaction. Valid signal 828 is one or more hand- 
shaking signals that may be used for a decoupled protocol to 
indicate the start of a memory transaction or to indicate when 
valid data is present on transaction bus 826. Valid signal 828 
may be monitored and generated by handshake logic 806 
under the control of control logic 802. Valid signal 828 may 
be omitted for a coupled protocol. Memory module controller 
800 also interfaces with memory devices on a memory mod- 
ule (as in FIG. 3) by providing a clock signal 830, address 
signals 832, control signals 823, and data signals 836. Clock 
signal 830 may be omitted for asynchronous memory 
devices. 

Memory module controller 800 includes request handling 
logic 804 for interfacing with transaction bus 826. Request 
handling logic 804 may include deserializing logic that may 
separate the multiplexed control, address, and data informa- 
tion provided on transaction bus 826 and provide these sig- 
nals to control logic 802 via lines 838, 840, and 842, respec- 
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lively. Request handling logic 804 may also include transaction bus 826. Data handling logic 804 deserializes ithe 

serializing logic that may serialize control, address, and data transaction at step 906 to obtain the address, control and data 

information on lines 838, 840, and 842, respectively, into a information of the transaction. At step 908, control logic 802 

time-multiplexed series of signals to be provided to transac- inspects the deserialized information and determines it the 

tion bus 826. 5 transaction is directed to a memory device of the module 

Control logic 802 is the intelligence of memory module controlled by memory module controller 800. This may be 
controller 800, and generates the appropriate control, accomplished by inspecting the memory address received to 
address, and data signals for the memory module memory see if it corresponds to an address occupied by one ot the 
devices in response to the signals received from request han- memory devices m the memory module. If the transaction is 
dling logic 804. Each memory module controller device in 10 not directed to a memory device controlled by memory mod- 
each module may have different control logic that may be ule controller 800, the process returns to step 902 It the 
implement a specific translation between the signal types and transaction is directed to a memory device controlled by 
protocol on the system memory bus and the specific memory memory module controller 800, control logic ; 802 determines 
signals and protocol expected by the memory devices on the what type of transaction is requested at step 910. It the trans- 
memory module. For example, control logic 802 may provide 1 5 action is a write transaction, control logic 802 generates the 
the appropriate address signals to address interface circuit appropriate write control signals (e.g., WE, CS, etc.) at step 
818 via lines 844, the appropriate control signals to control 9 12 and provides these signals to control interface circuit 820. 
interface circuit 820 via lines 846, and the appropriate data At step 914, control logic 802 then provides the write data m 
signals to data 170 circuitry 822 via lines 848. The interface the appropriate data format to data I/O circuitry 822 and the 
circuits may include buffers and register elements to drive 20 address of the selected memory device to address interface 
address 832, memory control signals 834, and data 836. circuit 818. The write data may be buffered m a write butter 

Interface circuits 818, 820, and 822 may be clocked by a (not shown). The data may then be written mto me desired 

clock signal generated by clock generator 810. Clock genera- memory location of the selected memory device. At step 916, 

tor 810 may also provide a clock signal to control logic 802 an optional acknowledge signal may be sent back to the 

and to clock buffers 816 which may drive clock signal 830 25 system memory controller after the wnte operation is com- 

and/or clock enable signals to memory devices on a memory pleted. The process then returns to step 902. 

module. Clock generator 810 may generate clock signals in If the transaction is a read transaction, control logic 802 

response to clock 824 provided from system memory bus then provides the read address of the selected memory device 

823. CLK 830 may be a different frequency than clock 824. to address interface circuit. At step 920 control logic 802 

Memory module controller 800 or clock generator 810 may 30 generates the appropnate read control signals (e.g., WE, CS, 

further include a DLL, clock buffer, or clock divider circuit OE, etc.) and provides these signals to control interface cir- 

that shapes or alters clock 824 before it reaches clock genera- cuit 820. The data may then be read from the desired memory 

tor § iq location of the selected memory device. The read data may be 

Memory module controller 800 may also include a power buffered in a read buffer (not shown), stored in control logic 
manager unit 808 that, under the control of control logic 802, 35 802, or registered. At step 922, the read data may be provided 
may enable or disable clock generator 810. This may, in turn, to request handling logic 804 where it is serialized and may be 
enable or disable clock 830 or a clock enable signal provided framed by other data including, for example, a request num- 
to the memory devices on a memory module so as to control ber indicating this particular read transaction. At step 924, the 
power dissipated by the memory devices. read data may then be sent back to the system memory con- 
Memory module controller 800 may further include 40 troller when system memory bus 823 is free or when all other 
refresh logic 814 and prefetch logic 812. Under the control of previous transactions have been completed. For one embodi- 
control logic 802, refresh logic 8 14 may send refresh control ment, handshake logic 806 or other logic (e.g. , request nan- 
signals to memory devices on a memory module via control dling logic 804, control logic 802, or other bus momtonng 
interface circuit 820. Control logic 802 may generate the logic) may monitor the activity on system memory bus 823 
refresh command at an appropriate time, or it may generate a 45 and indicate to control logic 802 when it is the turn of memory 
refresh command in response to a refresh command sent over module controller 800 to send its read data to the system 
transaction bus 826 from system memory controller 304. memory controller on bus system memory bus 823. The read 
Prefetch logic 812 may, under the control of control logic 802, data may be sent back with valid signal 828 in a decoupled 
prefetch a page of data from memory devices (e.g., DRAM system. The process then returns to step 902. 
devices) and store the prefetched data for use in memory read 50 FIG. 10 is a block diagram of memory module contro er 
transactions. 1000 mat is one embodiment of memory module controller 

Memory module controller 800 may further include serial 310 using a demultiplexed protocol. One embodiment of a 

presence detect circuitry, ECC circuitry, current calibration demultiplexed protocol may be Direct Rambus™ protocol, 

circuitry, and other circuitry that may be removed from either Other protocols may be also be used. It will also be appreci- 

the system memory controller or from the memory devices to 55 ated that memory module controller 1000 is only one embodi- 

reduce the complexity of the designs of these parts. This may ment of a memory module controller. Other embodiments 

reduce the number of pins on the system memory controller. may also be used without departing from the spirit and scope 

FIG. 9 shows a flow chart that illustrates one embodiment of the present invention, 

of the operation of memory module controller 800 for write Memory module controller 1000 interfaces between sys- 

and read transactions. The process may be a pipelined process 60 tern memory bus 1023 that includes one or more clock signal 

or implemented a single stage process. It will be appreciated lines 1024, a command and address bus CMD/ADDR 1026, 

that memory module controller 800 may perform many more data bus 1027, and may optionally include a valid signal 

functions besides translating write and read transactions 1028. CMD/ADDR bus 1026 may carry both address and 

between a system memory controller and memory devices on control information for a memory transaction. Alternatively, 

a memory module. <* CMD/ADDR bus 1026 may be separated into separate com- 

The process starts at step 902. At step 904, memory module mand and address buses. Valid signal 1028 is a handshaking 

controller 800 receives a memory transaction request on signal that may be used for a decoupled protocol to indicate 
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the start of a memory transaction or to indicate when valid 
data is present on transaction bus 1026. Valid signal may be 
monitored and generated by handshake logic 1006 under the 
control of control logic 1002. Valid signal 1028 may be omit- 
ted for a coupled protocol. Memory module controller 1000 5 
also interfaces with memory devices on a memory module (as 
in FIG. 3) by providing a clock signal 1030, address signals 
1032, control signals 1023, and data signals 1036. Clock 
signal 1030 may be omitted for asynchronous memory 
devices. 10 

Memory module controller 1000 includes request handling 
logic 1004 for interfacing with transaction bus 1026. Request 
handling logic 1004 may include deserializing logic that may 
separate the multiplexed control and address information pro- 
vided on CMD/ADDR bus 1026 and provide these signals to 1 5 
control logic 1002 via lines 1042 and 1044, respectively. 
Request handling logic 1004 may also include serializing 
logic that may serialize control and address information on 
lines 1042 and 144, respectively, into a series of signals to be 
provided to CMD/ADDR bus 1026. 20 

Memory module controller 1000 further includes data han- 
dling logic 1046 that may receive data from data bus 1027, 
reformat the data into a format appropriate for the memory 
devices of the memory module and provide the reformatted 
data to write buffer 1012. For one embodiment, data handling 25 
logic 1046 may include deserializing or unpacking logic to 
perform the translation between, for example, a narrow (e.g., 
1 6 bit) data bus 1027 and a wider (e.g., 64 bit) memory device 
data bus 1036. The data may be stored in write buffer 1012 
until it needs to be provided to a memory device via data I/O 30 
circuitry 1022. A corresponding address for the write data 
may be stored in address storage unit 1014. For an alternative 
embodiment, write buffer 1012 may be omitted. Data han- 
dling logic 1046 may also receive data from the memory 
devices of a memory module via data I/O circuitry 1022 35 
and/or read buffer 1038. Data handling logic may then refor- 
mat the data into a format expected by the protocol of system 
memory bus 1023. For one embodiment, data handling logic 
1046 may include serializing or packing logic to perform the 
translation between, for example, a wider (e.g., 64 bit) 40 
memory device data bus 1036 and a narrower (e.g., 16 bit) 
data bus 1027. For yet another embodiment, data handling 
logic may be omitted and the formatting of data may be 
performed by control logic 1002. 

Control logic 1002 is the intelligence of memory module 45 
controller 1000, and provides the appropriate control, 
address, and data signals for the memory module memory 
devices in response to the signals received from request han- 
dling logic 1004. Each memory module controller device in 
each mode may have different control logic that may be 50 
implement a specific translation between the signal types and 
protocol on the system memory bus and the specific memory 
signals and protocol expected by the memory devices on the 
memory module. For example, control logic 1002 may pro- 
vide the appropriate address signals to address interface cir- 55 
cuit 1018 via lines 1048, the appropriate control signals to 
control interface circuit 1020 via lines 1050, and the appro- 
priate data signals to data I/O circuitry 1022 by controlling 
write buffer 1012 via line 1052 and address storage 1014 via 
lines 1054. Control logic 1002 may also provide the appro- 60 
priate control signal to read buffer 1038 to control when data 
read from a memory device on a memory module is provided 
to data handling logic 1046. The interface circuits may 
include buffers and register elements to drive address 1032, 
memory control signals 1034 and data 1036. 65 

Interface circuits 1018, 1020, and 1022 may be clocked by 
a clock signal generated by clock generator 1010. Clock 



generator 1010 may also provide a clock signal to control 
logic 1002 and to clock buffers 1016 which may drive clock 
signal 1030 and/or clock enable signals to memory devices on 
a memory module. Clock generator 1010 may generate clock 
signals in response to a clock signal provided by DLL 1058. 
DLL 1058 may receive on or more clock signals 1024 pro- 
vided from system memory bus 1023. CLK 1030 may be a 
different frequency than clock 1024. 

Memory module controller 1000 may also include a power 
manager unit 1008 that, under the control of control logic 
1002 may enable or disable the clock generator. This may, in 
turn, enable or disable clock 1030 or a clock enable signal 
provided to the memory devices on a memory module so as to 
control power dissipated by these memory devices. 

Memory module controller 1000 may optionally include 
address storage unit 1040 coupled to control logic 1002, 
address interface circuit 1018, and optionally to clock gen- 
erator 1010. Address storage 1040 may be used to store 
address information that may be provided from CMD/ADDR 
1026. 

Memory module controller 1000 may further include 
refresh and prefetch logic as illustrated in FIG. 8 which oper- 
ates under the control of control logic 1002. Memory module 
controller 1000 may further include serial presence detect 
circuitry, ECC circuitry, current calibration circuitry, and 
other circuitry that may be removed from either the system 
memory controller or from the memory devices to reduce the 
complexity of the designs of these parts. This may reduce the 
number of pins on the system memory controller. 

FIG. 1 1 shows a flow chart that illustrates one embodiment 
of the operation of memory module controller 1000 for write 
and read transactions. The process may be a pipelined process 
or implemented a single stage process. It will be appreciated 
that memory module controller 1000 may perform many 
more functions besides translating write and read transaction 
between a system memory controller and memory devices on 
a memory module. 

The process starts at step 1102. At step 1104, memory 
module controller 1000 receives a memory transaction 
request on CMD/ADDR bus 1026. At step 1006, data han- 
dling logic 1004 unpacks or deserializes the command and 
address information and transmits this information to control 
logic 1002. At step 1106, control logic 1002 inspects the 
unpacked or deserialized information and determines if the 
transaction is directed to a memory device in the module 
controlled by memory module controller 1000. This may be 
accomplished by inspecting the memory address received to 
see if it corresponds to an address occupied by one of the 
memory devices in the memory module. If the transaction is 
not directed to a memory device controlled by memory mod- 
ule controller 1000, the process returns to step 1102. If the 
transaction is directed to a memory device controlled by 
memory module controller 1000, control logic 1002 deter- 
mines what type of transaction is requested at step 1110. If the 
transaction is a write transaction, control logic 1002 generates 
the appropriate write control signals (e.g., WE, CS, etc.) at 
step 1112 and provides these signals to control interface 
circuit 1020. Request handling logic 1004 may also provide 
the write address to address storage 1014. Alternatively, con- 
trol logic 1002 may provide the write address to address 
interface circuit 1018, for example, when write buffer 1012 is 
not used. At step 11 14, data handling logic 1046 accepts write 
data from 1027, unpacks or deserializes the write data, and 
provide the write data to write buffer 1012. At step 1116, the 
write data is provided in the appropriate data format to data 
I/O circuitry 1022. The data may then be written into the 
desired memory location of the selected memory device. At 
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step 1 1 18, an optional acknowledge signal may be sent back include a clock signal CLK 12 16, a clock enable signal CKE 
to the system memory controller after the write operation is 1 217, a write enable signal WE 12 18, a column address strobe 
completed. The process then returns to step 1102. signal CAS 1219, a row address strobe RAS 1220, and one or 

If the transaction is a read transaction, control logic 1002 cn j p select signals CS 1221. For one embodiment, the fre- 
generates the appropriate read control signals (e.g., WE, CS, 5 q ue ncy of the CLK 1208 and CLK 1216 may be approxi- 
OE, etc.) at step 1120 and provides these signals to control mately 100 MHz to 200 MHz. Other frequencies may be used, 
interface circuit 1020. At step 1122, control logic 1002 then Memory module controller also communicates memory 
provides the read address of the selected memory device to address signals SDRAMs 1204 and 1205 via address bus 
address interface circuit 1018. The data may then be read ]Q 1214, and to SDRAMs 1206 and 1207 via address bus 1222. 
from the desired memory location of the selected memory p or one embodiment, each address bus may include 12 
device. The read data may be buffered in read buffer 1038, address lines and an additional two bank select lines for 
stored in control logic 1002, or registered. At step 1124, the selecting banks of memory in each SDRAM device. In an 
read data may be provided to data handling logic 1046 where alternative embodiment, control bus 1238 and 1240 may be 
it is serialized or packed and may be framed by other data 15 me same bus as shown in FIG. 3. Similarly, address buses 
including, for example, a request number indicating this par- 1214 and 1222 may be the same bus. Memory module con- 
ticular read transaction. At step 1126, the read data may then troller also communicates read and write data with SDRAMs 
be sent back to the system memory when the system memory 1204, 1205, 1206, and 1207 via signal lines 1224, 1225, 1226, 
bus is free or when all other previous transactions have been ^ and 1227, respectively. For one embodiment, each group of 
completed. For one embodiment, handshake logic 1006 or signal lines may include 16 data lines, 
other logic (e.g., request handling logic 1004, data handling pjQ 13 snows on e embodiment of a process implemented 
logic 1046, control logic 1002, or other bus monitoring logic) by memory module controller 1202 to perform a read trans- 
may monitor the activity on system memory bus 1023 and action from one or more of SDRAMs 1204-1207 after receiv- 
indicate to control logic 1002 when it is the turn of memory 25 ' m a a read request from system memory bus 1242. FIG. 13 is 
module controller 1000 to send its read data to the system described with the aid of the exemplary timing diagram of 
memory controller on bus system memory bus 1023. Valid FIG. 14. It will be appreciated that FIG. 14 shows CLK 1228 
read data may be sent back with valid signal 1028 in a having approximately twice the frequency of CLK 1208. For 
decoupled system. The process then returns to step 1102. one embodiment, CLK 1228 may have a frequency of 

FIG. 12 is a block diagram of memory module 1200 that is approximately 400 MHz and CLK 1208 may have a fre- 
one embodiment of memory module 306 of FIG. 3. Memory quency of approximately 200 MHz. For other embodiments, 
module 1200 is an SDRAM module that includes SDRAM different ratios of frequencies, and/or different frequencies, 
devices 1204-1207 and memory module controller 1202. may be used. 

Memory module controller 1202 provides a bridge between 35 Memory module controller 1202 may implement the pro- 
system memory bus 1242 using a Direct Rambus™ protocol C ess of FIG. 13 using the circuitry shown in memory module 
(and coupled to a system memory controller) and SDRAM 1000 of FIG. 10. For example, CLK 1024 corresponds to 
devices 1204-1207. The Direct Rambus™ protocol includes CLK 1228, CMD/ADDR 1026 corresponds to row 1234 and 
clock signals CLK 1228, /CLK 1230 (where the symbol l T column 1236, data 1027 corresponds to data 1232, CLK 1030 
indicates a complementary signal), data lines 1232, row 40 corresponds to CLK 1208, address 1032 corresponds to 
address lines 1234, and column address lines 1236. The data address 1214, memory control signals 1034 corresponds to 
may include 1 6 signals lines, the row address may include 3 control bus 1238, and data 1036 corresponds to data 1224. For 
signal lines, and the column address may include 5 signal other embodiments, other circuitry may be used to implement 
lines as described in the Advance Information Direct 45 the process of FIG. 13. 

RDRAM™ 64/72-Mbit (256Kxl6/18xl6d) data sheet. For The process starts at step 1302. At step 1304 and from time 
one embodiment, CLK 1228 and /CLK 1230 may have a t0 to time tl, an activate command is sent on row lines 1234 
frequency *of approximately 400 MHz. Other signals used by including a device, bank, and row address of selected memory 
this protocol are not shown so as not to obscure the present locations in one or more of SDRAMs 1204-1207. At step 
invention. 50 1306 and from time t2 to time t3, data request logic 1004 

Memory module controller 1202 provides memory trans- deserializes the command and address information and pro- 
actions received from system memory bus 1242 to SDRAMs vides this information to control logic 1002. Control logic 
1204-1207. For one embodiment, SDRAMs 1 204-1207 may 1002 then provides the row address to the selected SDRAMs 
be 64 Mb SDRAMs such as described in the prehminary data 55 over address bus 1214 and/or 1222, and the appropriate bank 
sheet of IBM's IBM0364804C, IBM 0364 164C, activate command to the selected SDRAMs over control bus 
IBM0364404C, and IBM03644B4C products published in 1238 and/or 1240. For one embodiment, the appropriate bank 
November 1997. Other SDRAMs may also be used. activate command includes disabling CAS lines 1211 and/or 

Memory module controller 1202 provides first control 1219 and WE lines 1210 and/or 1218, and enabling CS lines 
information to SDRAMs 1204 and 1205 over control bus 60 1213 and/or 1221 and RAS lines 1212 and/or 1220 at the 
1238, and second control information to SDRAMs 1206 and rising edge of CLK 1208 and/or 1216. 
1207 over control bus 1240. Control bus 1238 may include a . Because the memory addressing scheme protocol used by 
clock signal CLK 1208, a clock enable signal CKE 1209, a Direct RDRAM™ devices may be different than that used by 
write enable signal WE 1210, a column address strobesignal 65 the selected SDRAMs, the activate command supplied on row 
CAS 1211, a row address strobe RAS 1212, and one or chip address lines 1234 may include column address information 
select signals CS 1213. Similarly, control bus 1240 may for the selected SDRAMs. In this example, this column 
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address information may be stored in address storage unit a write request from system memory bus 1242. The same 

1040 until such time that the column address information is process may be used to write data to any of the SDRAMs. 

issued to the selected SDRAMs. FIG. 15 is described with the aid of the exemplary timing 

At step 1308 and from time t4 to time t6, a read command diagram of FIG. 16. Memory module controller 1202 may 

is sent on column lines 1236. The read command includes 5 implement the process of FIG. 13 using the circuitry shown in 

device, bank, and column address information for the desired memory module 1000 of FIG. 10. 

read location in the selected SDRAMs . At step 1310 and from It will be appreciated that FIG. 15 shows CLK 1228 having 

time t6 to time t7, request handling logic 1004 deserializes the approximately twice the frequency of CLK 1208. For one 

read command and provides this information to control logic ]0 embodiment, CLK 1228 may have a frequency of approxi- 

1002. Control logic 1002 then provides the column address mately 400 MHz and CLK 1208 may have a frequency of 

and the read command to the selected SDRAMs over address approximately 200 MHz. For other embodiments, different 

bus 1214 and/or 1222 and over control bus 1238 and/or 1240, ratios of frequencies, and/or different frequencies, may be 

respectively. For one embodiment, the appropriate read com- used. 

mand includes disabling RAS lines 1212 and/or 1220 and WE 15 jj ie p rocess starts at step 1502. At step 1504 and from time 

lines 1210 and/or 1218, and enabling CS lines 1213 and/or $ t0 t j m activate command is sent on row lines 1234 

1221 and CAS lines 1211 and/or 1219 at the rising edge of including a device, bank, and row address of memory loca- 

CLK 1208 and/orCLK 1216. tions in one or more of selected SDRAMs 1204-1207. At step 

If there is a difference between the number of bytes 20 data re q U est logic 1004 deserializes the command and 

selected in the selected SDRAMs and the number of bytes address information and provides this information to control 

expected from a single read transaction by the system logic 1002. 

memory controller, then steps 1308 and 1310 may be repeated Because the memory addressing scheme protocol used by 

a desired number of times to match the number of bytes. For Direct ^r^^tm device s may be different than that used by 

example, as shown in FIG. 14, if the first read command 25 SDRAMs 12 04-1207 ) tlie activate command supplied on row 

READ1 on column 1236 (together with the activate com- VmQS n34 may mclude column address information 

mand on row 1234) addresses 16 bytes of data and the read for ±Q selected SDRAMs. In this example, this column 

command to the selected SDRAMs addresses 32 bytes of addresg ^f^^on may ^ st0 red in address storage unit 

data, then a second read command READ2 may be issued 30 1Q40 ^ guch ^ tMt ±Q colunm address information is 

from time t6 to time t9 to address the second 16 bytes. igsued tQ ^ selected SDRAMs. 

Atstepl312andfromtime^ At step 1508 and from toe t2 to time t3, a write command 

1022 may receive data read from me selected SDRAMs. For ^ ^ ^ 

™fi ?2n?5v! r ? \T 7 f Z 35 ^ce, bank, and column address information for the desired 

SDRAMs 1204-1207 in the fo lowmg manner: from ^ 35 > ^ 

to time tlO data I/O circuitry 1022 may receive data packet , j,- , ■ inn* a • r +u ^ .Ln^nH 

_ ' . , J , „ . i! i . / , < ^ u * request handling logic 1004 deserializes the write command 

DO that includes the first eight bytes, two bytes from each of y 5 * * n ■ mm t^^;, 

^ ^ ct^ax* t *>a a n L I \- .in. ♦i™*** and provides this information to control logic 1002. If there is 

the four SDRAMs 1204-1207; from time tlO to tune tl2 data J .*: , ^_ . , ~ u . Z>^**a fx*,™^™ 

, T ~\ , A . . , 4 « , ■ , . u ^ + , u . „ a difference between the number of bytes selected for writing 

packet Dl that mcludes the second eight bytes, two bytes avii J 

r ^ T;' f TnDAM a. ♦n trt ti ffl ,tn 40 m the selected SDRAMs and the number of bytes selected by 

from each of tte four SDRAMs from time U2 to time t!3 ^ immd m 

data packet D2 that mcludes the third eight bytes two bytes > ' des hed number of times to match the number of 

from each of the four SDRAMs and from tune t!3 to time £J write 

tl4data^cketD3tM^ cLumdWRTlBl on column 1236 (together with the acti- 

fromeachofthe four SDRAMs. It wiUbeappreciatedthat fo 45 ^ ^ ^ ^ g Qf ^ and ^ 

otherembodimentsadifferentnumberofbytesandadinerent ^cnDA^n ^r^^n,^ 

r i u • a * * a wnte command to the selected SDRAMs addresses 32 bytes 

number of cycles may be required to read the selected data of ^ (ftenaseTOnd ^ terommandWRrrE 2maybeUsued 

from the selected SDRAMs. from time t3 to time t4 to address the second 16 bytes. 

When the read data is received, it may be stored in read , 

buffer 1038 prior to providing the data to data handling logic 50 At step 1512 and from time t5 to time t6, data handling 

1046. Alternatively, it may be provided directly to data nan- logic 1046 may receive write data DATA1 from data bus 1232 

dling logic 1046. At step 1314, data handling logic may and may unpack or deserialize the wnte data. Data handling 

serialize or pack the data into the proper format expected by logic 1046 may store the write data DATA1 into wnte buffer 

the system memory controller on data bus 1232. For one 55 "> 12 - ^ address stora 8 e 1014 ^V™* addreSS 

embodiment, data packets DO and Dl, including a total of 1 6 output by request handling logic 1004. If a subsequent wnte 

bytes of data from SDRAMs 1204-1207, may be packed into or read command is received, control logic 1002 may inspect 

one uninterrupted transmission DATA1 that may provided to write buffer 1012 and address storage 1014 for the requested 

data bus 1232 at step 1316 and from time til to time tl5. address. Ifthe address is located m address storage 1014, then 

Similarly, data packets D2 and D3, including a second 16 60 corresponding data in write buffer 1012 may be read or 

bytes of data from SDRAMs 1204-1207 may be packed into overwritten. If a subsequent wnte command WRTTE2 is 

one uninterrupted transmission DATA2 that may provided to issued, then DATA2 received from time t8 to time tlO, and 

data bus 1232 at step 1316 and from time tl4 to time tl6. associated with this command, may be unpacked or desenal- 

FIG. 15 shows one embodiment of a process implemented 65 ized and also stored in wnte buffer 1012. 

by memory module controller 1 202 to perform a write trans- At step 15 16 and from time t6 to time t7, control logic 1002 

action to one or more of SDRAMs 1204-1207 after receiving then provides the row address to the selected SDRAMs over 
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address bus 1214 and/or 1222, and the appropriate bank acti- 
vate command to the selected SDRAMs over control bus 
1238 and/or 1240. For one embodiment, the appropriate bank 
activate command includes disabling CAS lines 1211 and/or 
1219 and WE lines 1210 and/or 1218, and enabling CS lines 
1213 and/or 1221 and RAS lines 1212 and/or 1220 at the 
rising edge of CLK 1208 and/or CLK 1216. At step 1518 and 



TABLE 1 



Cycle RQ[7] 


RQflS] 


RQ[5] 


RQ[4] 


RQ[3] 


RQ[2] 


RQ[1] 


RQ[0] 


0 ST 

0 R[6] 

1 R[13] 


SF 

R[5] 

R[12] 


D[4] 
R[4] 
R[llj 


D[3] 
R[3] 
R[10] 


D[2] 
R[2] 
R[P] 


D[l] 
R[l] 
R[8] 


D[0] 
R[0J 
R[7] 


B[0] 
B[l] 
B[2] 



selected memory locations in SDRAMs 1204-1207. In this 
embodiment, the activate command may be spread over two 
cycles (i.e., cycle 0 and cycle 1 in Table 1 below) of CLK 1228 
in which data is transferred on each clock edge of the CLK 
5 1228 (i.e., double-pumped). For one embodiment the packet 
format is as shown in Table 1 where RQ[7:0] correspond to 
the signal lines of control bus 1235. 



from time t9 to time tl 1 , control logic 1002 then provides the 
column address and the write command to the selected 2Q 
SDRAMs over address bus 1214 and/or 1222 and control bus 
1238 and/or 1240, respectively. For one embodiment, the 
appropriate write command includes disabling RAS lines 
1212 and/or 1210 and enabling CS lines 1213 and/or 1221, 
RAS lines 1212 and/or 1210, and WE lines 1210 and/or 1218 25 
at the rising edge of CLK 1208 aid/or CLK 1216. 

At step 1520 and from time t9 to time tl4, control logic may 
cause the write data to be provided to the selected SDRAMs 
on data lines 1224, 1225, 1226, and/or 1227 from data I/O ^ 
circuitry 1022. For example, 32 bytes of data may be written 
to the four SDRAMs 1204-1207 in the following manner: 
from time t9 to time til data I/O circuitry 1022 may provide 
data packet DO including the first eight bytes, two bytes to 
each of the four SDRAMs ; and from time tl 1 to time tl2 data 35 
packet Dl including the second eight bytes, two bytes to each 
of SDRAMs 1204-1207. DO and Dl may correspond to 
DATA1. Additionally, from time tl2 to time tl3 data I/O 
circuitry 1022 may provide data packet D2 including the third 
eight bytes, two bytes to each of SDRAMs 1204-1207, and 40 
from time tl3 to time tl4 data packet D3 including the last 
eight bytes, two bytes to each of SDRAMs 1204-1207. D2 
and D3 may correspond to DATA2 . It will be appreciated that 
for other embodiments a different number of bytes and a 45 
different number of cycles may be required to write the 
selected the data to the selected SDRAMs. Although in this 
example all DRAMs are written to, in alternative embodi- 
ments a partial write to one (or less than all) of the SDRAMs 
may be executed. 

In an alternative embodiment, memory module controller 
102 may also provide a bridge between system memory bus 
1242 and SDRAMs 1204-1207 using a modified protocol. 
The modified protocol may be demultiplexed having a data 55 
bus and a separate control bus that transmits control informa- 
tion and address between a system memory controller (e.g., 
system memory controller 304 of FIG. 3) and memory mod- 
ule controller 1202. 

In this embodiment, a read transaction from one or more of 60 
SDRAMs 1204-1207 may be performed as shown in FIG. 17 
wherein row bus 1234 and column bus 1236 are used as one 
control bus 1235 having eight signal lines. For other embodi- 
ments, a different number of signal lines may be used. 65 

From time tO to time tl, an activate command is sent on 
control bus 1235 including a device, bank, and row address of 



The activate command includes several fields: 
B[2:0] Bank Select: Selects one of eight banks in SDRAMs 
1204-1207; 

D[4:0] Device Select: Selects one of 2 5 or 32 memory 
module controllers; 

R[13:0] Row Address: Provides a row address for one or 
more locations selected in SDRAMs 1204-1207; and 

SX SF Encoded Frame/Fast Command: Bits used to indi- 
cate whether a command is framed as indicated in Table 
2. The Extended commands may include noop, pre- 
charge, refresh, and other commands. 

TABLE 2 



ST SF Operation 



0 0 No Framing 

0 1 Frame an Active Command (page 

activate) 

1 0 Frame a Read/Write Command 

(page hit) 

1 1 Frame an Extended Command 



From time t2 to time t3, data request logic 1004 deserial- 
izes the command and address information and provides this 
information to control logic 1002. Control logic 1002 then 
provides the row address to the selected SDRAMs over 
address bus 1214 and/or 1222, and the appropriate bank acti- 
vate command to the selected SDRAMs over control bus 
1238 and/or 1240 (e.g., as described above with respect to 
FIGS. 13 and 14). 

From time t4 to time t5, a read command is sent on control 
bus 1235. The read command includes device, bank, and 
column address information for the desired read locations in 
the SDRAMs. In this embodiment, the read command may be 
spread over two cycles (i.e., cycle 0 and cycle 1 in Table 3 
below) of CLK 1228, and have a packet format as shown in 
Table 3. 
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TABLE 3 



Cycle RQ[7] 


RQ[6] 


RQ[5] 


RQ[4] 


RQ[3] 


RQ[2] 


RQ[1] 


RQ[0] 


0 ST 


SF 


D[4] 


D[3] 


D[2] 


D[l] 


D[0] 


B[0] 


0 C[6] 


C[5] 


C[4] 


C[3] 


C[2] 


C[l] 


C[0] 


C[l] 


1 AP 


R/W 


C[ll] 


C[10] 


C[9] 


C[8] 


C[7] 


C[2] 



The read command includes several different fields not io 
present in the activate command: 

C[l 1:0] Row Address : Provides a column address for one 

or more locations selected in SDRAMs 1204-1207; 
R/W Read Write: indicates whether the command is a read 

transaction or a write transaction. When this signal is in 15 

one logical state it indicates a read transaction, and when 

it is in the complementary logic state it indicates a write 

transaction; and 
AP Autoprecharge: Indicates whether the selected column 

(or row) of selected memory cells should be precharged 20 

after reading. 

From time t6 to time t8, request handling logic 1004 dese- 
rializes the read command and provides this information to 
control logic 1002. Control logic 1002 then provides the 25 
column address and the read command to the selected 
SDRAMs over address bus 1214 and/or 1222 and over control 
bus 1238 and/or 1240, respectively, (e.g., as described above 
with respect to FIGS. 13 and 14). If the first read command 
READ1 on control bus 1235 addresses less bytes of data and 3Q 
the read command issued to SDRAMs 1204-1207, then a 
second read command READ2 may be issued from time t7 to 
timet9. 

From time tlO to time tl6, data I/O circuitry 1022 may 
receive data read from the selected SDRAMs. For example, 35 
32 bytes of data may be read from the four SDRAMs 
1204-1207 in the following manner: from time tlO to time tl 1 
data I/O circuitry 1022 may receive data packet DO that 
includes the first eight bytes, two bytes from each of the four 
SDRAMs 1204-1207; from time til to time tl2 data packet 40 
Dl that includes the second eight bytes two bytes from each 
of the four SDRAMs; from time tl3 to time tl4 data packet 
D2 that includes the third eight bytes, two bytes from each of 
the four SDRAMs; and, from time tl4 to time tl6 data packet 
D3 that includes the last eight bytes, two bytes from each of 45 
the four SDRAMs. It will be appreciated that for other 
embodiments a different number of bytes and a different 
number of cycles may be required to read the selected data 
from the selected SDRAMs. 

When the read data is received,- it may be stored in read 50 
buffer 1038 prior to providing the data to data handling logic 
1046. Alternatively, it may be provided directly to data han- 
dling logic 1046. At step 1314, data handling logic may 
serialize or pack the data into the proper format expected by 
the system memory controller on data bus 1232. For one 55 
embodiment, data packets DO and Dl, including a total of 1 6 
bytes of data from SDRAMs 1204-1207, may be packed into 
one uninterrupted transmission DATA! that may provided to 
data bus 1232 from time tl2 to time tl5. Similarly, data 
packets D2 and D3, including a second 1 6 bytes of data from 60 
SDRAMs 1204-1207 may be packed into one uninterrupted 
transmissionDATA2 thatmay provided to data bus 1232 from 
time tlSto time tl7. 

For this embodiment, a write transaction to one or more of 
SDRAMs 1204-1 207 may be performed as shown in FIG. 18 . 65 
From time tO to time tl, an activate command as shown in 
Table 1 is sent on control bus 1235 including a device, bank, 



and row address of memory locations in one or more of 
SDRAMs 1204-1207. Data request logic 1004 deserializes 
the command and address information and provides this 
information to control logic 1002. 

From time t2 to time t3, a write command is sent on control 
bus 1235 that includes device, bank, and column address 
information for the desired write locations in SDRAMs 
1204-1207. The write command uses the packet format 
shown in Table 3 with the R/W bit set appropriately to indi- 
cate a write transaction. Request handling logic 1004 deseri- 
alizes the write command and provides this information to 
control logic 1002. If there is a difference between the number 
of bytes selected for writing in SDRAMs 1204-1207(e.g., 32 
bytes) and the number of bytes selected by the single write 
transaction issued by the system memory controller (e.g., 16 
bytes), then the first write command WRITE 1 on control bus 
1235 may write a first amount (e.g., 16 bytes) of data, and a 
second write command WRITE2 may be issued from time t4 
to time t5 to write a second amount of data (e.g., another 16 
bytes). 

From time t6 to time t9, data handling logic 1046 may 
receive write data DATA1 from data bus 1232 and may 
unpack or deserialize the write data. Data handling logic 1046 
may store the write data DATA1 into write buffer 1012, and 
address storage 1014 may store the write address output by 
request handling logic 1004. If a subsequent write or read 
command is received, control logic 1002 may inspect write 
buffer 1012 and address storage 1014 for the requested 
address. If the address is located in address storage 1014, then 
the corresponding data in write buffer 1012 may be read or 
overwritten. If a subsequent write command WRITE2 is 
issued, then DATA2 received from time t9 to time til, and 
associated with this command, may be unpacked or deserial- 
ized and also stored in write buffer 1012. 

From time t7 to time t8, control logic 1002 then provides 
the row address to the selected SDRAMs over address bus 
1214 and/or 1222, and the appropriate bank activate com- 
mand to SDRAMs 1204-1207 over control bus 1238 and/or 
1240 (e.g., as described above with respect to FIGS. 15 and 
16). From time til to time tl2, control logic 1002 then pro- 
vides the column address and the write command to the 
selected SDRAMs over address bus 1214 and/or 1222 and 
over control bus 1238 and/or 1240, respectively (e.g., as 
described above with respect to FIGS. 15 and ,16). 

From time tlO to time tl5, control logic may cause the 
write data to be provided to the selected SDRAMs on data 
lines 1224, 1225, 1226, and/or 1227 from data I/O circuitry 
1022 . For example, 32 bytes of data may be written to the four 
SDRAMs 1204-1207 in the following manner: from time 1 10 
to time tl2 data I/O circuitry 1022 may provide data packet 
DO including the first eight bytes, two bytes to each of the four 
SDRAMs; and from time tl2 to time tl3 data packet Dl 
including the second eight bytes, two bytes to each of 
SDRAMs 1204-1207. DO and Dl may correspond to 
DATA1. Additionally, from time tl3 to time tl4 data I/O 
circuitry 1022 may provide data packet D2 including the third 
eight bytes, two bytes to each of SDRAMs 1204-1207, and 
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from time tl4 to time tl5 data packet D3 including the last 10. A system, comprising: 

eight bytes, two bytes to each of SDRAMs 1204-1207. D2 a memory interconnect; 

and D3 may correspond to DATA2. It will be appreciated that a system memory controller coupled to the memory inter- 

for other embodiments a different number of bytes and a connect; and 

different number of cycles may be required to write the 5 a first memory module coupled to the memory intercon- 

selected the data to the selected SDRAMs. Although in this nect, the first memory module including 

example all DRAMs are written to, in alternative embodi- a first plurality of memory devices and 

ments a partial write to one (or less than all) of the SDRAMs a first memory module controller coupled to the first 

may be executed. plurality of memory devices and the memory inter- 

Although the present invention has been described hi terms i o connect to receive a memory request signal from the 

of specific embodiments, it will be appreciated that various system memory controller via the memory intercon- 

modifications and alterations might be made by those skilled nect, 

in the art without departing from the spirit and scope of the in response to the memory request signal, the first 

invention. The invention should therefore be measured in memory module controller, to generate a separate 

terms of the claims which follow. is signal addressed to and to be serviced by at least one 

of the plurality of memory devices in a manner inde- 

. pendent of any difference of signal impedance or 

What is claimed is: operating voltage between the memory devices and 

1 . A method, comprising : me sy stem mem0 ry interconnect. 

receiving, at a memory module controller of a memory 20 n The system of claim 10, wherein the first memory 
module having a plurality o f memory devices, a memory module controller further comprises a clock generator to gen- 
request signal from a system memory controller over a erate a clodc signa j to fav Q me separate signal, wherein the 
system memory interconnect; and c i oc ^ s i gna ] j s different than a clock signal of the memory 

in response to the memory request signal, causing the interconnect, 
memory module controller to generate a separate signal 2 $ 12. The system of claim 11, wherein first memory module 
addressed to and to be serviced by at least one of the controUer further comprises a request handling logic to exam- 
plurality of memory devices in a manner independent of me me memory request to determine whether the memory 
any difference of signal impedance or operating voltage request is addressed to at least one of the memory devices and 
between the memory devices and the system memory to ignore the memory request if the memory request is not 
interconnect. 30 addressed to any of the memory devices. 

2. The method of claim 1, further comprising generating a 13. The system of claim 12, wherein the first memory 
separate clock signal via a clock generator within the memory module controller further comprises a power management 
module controller to drive the separate signal, the separate unit to control a power supplied to the memory devices, 
clock signal being different than a clock signal of the system 14. Hie system of claim 13, wherein the first plurality of 
memory interconnect. 35 memory devices and the memory interconnect operate at 

3. The method of claim 1, further comprising: different power voltages. 

examining the memory request signal to determine 15. The system of claim 13, wherein the power manage- 

whether the memory request signal is addressed to at ment unit reduces at least a portion of the power to the 

least one of the memory devices of the respective memory devices, if the memory request is not addressed to 

memory module; and 40 any of the memory devices. 

bypassing the memory request signal if the memory 16. The system of claim 13, wherein the first memory 

request signal is not addressed to any of the memory module controUer further compnses a control logic coupled 

devices of the memory module. to the request handling logic, the clock generator, and the 

4. The method of claim 3, further comprising reducing at P<wer management unit, the control logic configured to 
least a portion of a power associated with the plurality of 45 decouple the memory devices from the memory interconnect 
memory devices if the memory request signal is not addressed if the memory request is not addressed to any of the memory 

to any of the memory devices. de Y lce il - , . ^ , • ■ , 

^ tu a j r i ■ * a-u •• a «~ o 17. The system of claim 16, wherein in response to a signal 

frecuSroftSe se« doSXiS from * e ^ lc * ic that m ^ 

frequency ot the separate clock signal with respect to toe addressed to any of the memory devices, the 

plurahty of memory devices if the memory request signal is co q ntroll ic mgtructs me dock y generator to alter a frequency 

not addressed to any of the memory devices. Qf ^ ^ {Q ^ deyices 

6. The method of claim 3, further comprising decoupling 18 The system of claim 17) wherein me contro i i og i c 
the plurality of memory devices from the system memory mstructs me power management unit to disable the 
interconnect if the memory request signal is not addressed to 55 dock generator if me memory request is not addressed to any 
any of the memory devices, such that the plurahty of memory Qf ±Q memory devices, which in turn reduces the power 
devices remam inactive. dissipation of the memory devices. 

7. The method of claim 3, further comprising providing the 19. The system of claim 10, further comprising a second 
separate clock signal and power to the memory devices of the memory module coupled to the memory interconnect, the 
memory module only if the memory request signal is 60 se cond memory module including: 

addressed to at least one of the memory devices. a secon d plurality of memory devices and 

8 . The method o f cla im 1 , wherein the plurality o f memory a second memory module controller coupled to the second 
devices and the system memory controller operate at different plurahty of memory devices and the memory intercon- 
power voltages. nect, the second memory module controller managing 

9. The method of claim 1, wherein the plurality of memory 65 the second plurality of memory devices independent of 
devices and the memory controller operate at different oper- the first memory module controller of the first memory 
ating frequency signals having different voltage swings. module and the second memory module controller sepa- 
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rating the second plurality of memory devices of the 
second memory module from the system memory con- 
troller and the memory interconnect. 
20. The system of claim 19, wherein the first plurality of 
memory devices and the second plurality of memory devices 
have different signaling protocols, which are controlled by 
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the first and second memory module controllers respectively, 
and wherein the different signaling protocols of the first and 
second pluralities of memory devices are incompatible with 
signaling protocols required by the system memory controller 
5 and the memory interconnect. 

***** 



